pipelines: add generate command by kanterov · Pull Request #4251 · databricks/cli

kanterov · 2026-01-12T09:16:08Z

Changes

Add databricks pipelines generate command that generates DAB resources from SDP YAML.

generate command is tailored to lakeflow-pipelines template where src folder contains pipeline folders, for example:

├── databricks.yml
├── pyproject.toml
├── README.md
├── resources
│   ├── my_pipeline.pipeline.yml
│   └── my_pipeline.job.yml
└── src
    └── my_pipeline
        ├── spark-pipeline.yml
        └── transformations
            ├── example_python_materialized_view.py
            └── example_sql_materialized_view.sql

Usage

$ databricks pipelines generate src/my_pipeline

Where src/my_pipeline/sdp-pipeline.yml:

name: My Pipeline
storage: file:///Users/foo/bar/baz
libraries:
  - glob:
      include: transformations/**

Produces resources/my_pipeline.pipeline.yml:

resources:
  pipelines:
    my_pipeline:
      name: My Pipeline
      catalog: ${var.catalog}
      schema: ${var.schema}
      root_path: ../src/my_pipeline
      serverless: true
      libraries:
        - glob:
            include: ../src/my_pipeline/transformations/**
      environment:
        dependencies:
          - --editable ${workspace.file_path}

Why

It allows creating DAB YAML for Spark Declarative Pipelines

Tests

Acceptance and unit tests

eng-dev-ecosystem-bot · 2026-01-12T09:46:00Z

Commit: 2d546c1

Run: 20960690811

	Env	🟨KNOWN	🔄flaky	💚RECOVERED	🙈SKIP	✅pass	🙈skip	Time
🟨	aws linux	7		17	2	383	690	33:10
🟨	aws windows	10		14	2	385	688	35:06
🟨	aws-ucws linux	3		21	2	534	567	72:01
🟨	aws-ucws windows	6		18	2	536	565	61:59
💚	azure linux			19	3	383	689	40:15
🟨	azure windows	4		15	3	385	687	37:39
💚	azure-ucws linux			19	3	530	566	74:21
🟨	azure-ucws windows	4	2	13	3	532	564	66:57
💚	gcp linux			19	3	372	695	37:36
🟨	gcp windows	4	4	15	3	370	693	44:53

30 interesting tests: 13 RECOVERED, 10 KNOWN, 6 flaky, 1 SKIP

	Test Name	aws linux	aws windows	aws-ucws linux	aws-ucws windows	azure linux	azure windows	azure-ucws linux	azure-ucws windows	gcp linux	gcp windows
🟨	TestAccept	🟨K	🟨K	🟨K	🟨K	💚R	🟨K	💚R	🟨K	💚R	🟨K
💚	TestAccept/bundle/deployment/bind/alert	🙈S	🙈S	🙈S	🙈S	💚R	💚R	💚R	💚R	💚R	💚R
🟨	TestAccept/bundle/generate/alert	💚R	🟨K	💚R	🟨K	💚R	🟨K	💚R	🟨K	💚R	🟨K
🟨	TestAccept/bundle/generate/alert/DATABRICKS_BUNDLE_ENGINE=direct	💚R	🟨K	💚R	🟨K	💚R	🟨K	💚R	🟨K	💚R	🟨K
🟨	TestAccept/bundle/generate/alert/DATABRICKS_BUNDLE_ENGINE=terraform	💚R	🟨K	💚R	🟨K	💚R	🟨K	💚R	🟨K	💚R	🟨K
💚	TestAccept/bundle/resources/alerts/basic	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R
🔄	TestAccept/bundle/resources/alerts/basic/DATABRICKS_BUNDLE_ENGINE=direct	💚R	💚R	💚R	💚R	💚R	💚R	💚R	🔄f	💚R	💚R
🔄	TestAccept/bundle/resources/alerts/basic/DATABRICKS_BUNDLE_ENGINE=terraform	💚R	💚R	💚R	💚R	💚R	💚R	💚R	🔄f	💚R	💚R
💚	TestAccept/bundle/resources/alerts/with_file	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R
💚	TestAccept/bundle/resources/alerts/with_file/DATABRICKS_BUNDLE_ENGINE=direct	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R
💚	TestAccept/bundle/resources/alerts/with_file/DATABRICKS_BUNDLE_ENGINE=terraform	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R
🙈	TestAccept/bundle/resources/permissions	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🟨	TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/with_permissions	🟨K	🟨K	🟨K	🟨K	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🟨	TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/with_permissions/DATABRICKS_BUNDLE_ENGINE=direct	🟨K	🟨K	🟨K	🟨K
🟨	TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/with_permissions/DATABRICKS_BUNDLE_ENGINE=terraform	🟨K	🟨K	💚R	💚R
🟨	TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/without_permissions	🟨K	🟨K	💚R	💚R	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🟨	TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/without_permissions/DATABRICKS_BUNDLE_ENGINE=direct	🟨K	🟨K	💚R	💚R
🟨	TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/without_permissions/DATABRICKS_BUNDLE_ENGINE=terraform	🟨K	🟨K	💚R	💚R
🔄	TestAccept/bundle/resources/pipelines/auto-approve/DATABRICKS_BUNDLE_ENGINE=direct	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	🔄f
🔄	TestAccept/bundle/resources/pipelines/auto-approve/DATABRICKS_BUNDLE_ENGINE=terraform	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	🔄f
🔄	TestAccept/bundle/templates/default-python/integration_classic/DATABRICKS_BUNDLE_ENGINE=terraform/UV_PYTHON=3.10	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	🔄f
🔄	TestAccept/bundle/templates/default-python/integration_classic/DATABRICKS_BUNDLE_ENGINE=terraform/UV_PYTHON=3.13	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	🔄f
💚	TestAccept/ssh/connection	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R
💚	TestExport	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R
💚	TestExportWithFileFlag	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R
💚	TestImportDir	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R
💚	TestImportDirDoesNotOverwrite	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R
💚	TestImportDirWithOverwriteFlag	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R
💚	TestImportFileFormatAuto	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R
💚	TestImportFileFormatSource	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R

Top 50 slowest tests (at least 2 minutes):

duration	env	testname
8:44	aws windows	TestAccept/bundle/resources/clusters/deploy/update-after-create/DATABRICKS_BUNDLE_ENGINE=terraform
6:45	azure-ucws linux	TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_BUNDLE_ENGINE=direct/DLT=no/NBOOK=no/PY=yes/READPLAN=1
6:15	aws-ucws linux	TestAccept/bundle/resources/clusters/deploy/update-after-create/DATABRICKS_BUNDLE_ENGINE=direct
6:12	gcp windows	TestAccept/bundle/resources/clusters/deploy/update-after-create/DATABRICKS_BUNDLE_ENGINE=terraform
5:55	aws linux	TestAccept/bundle/resources/clusters/deploy/update-after-create/DATABRICKS_BUNDLE_ENGINE=terraform
5:55	gcp linux	TestAccept/bundle/resources/clusters/deploy/update-after-create/DATABRICKS_BUNDLE_ENGINE=terraform
5:52	aws-ucws linux	TestAccept/bundle/resources/synced_database_tables/basic
5:52	aws-ucws linux	TestAccept/bundle/resources/clusters/deploy/update-after-create/DATABRICKS_BUNDLE_ENGINE=terraform
5:37	azure-ucws linux	TestAccept/bundle/resources/clusters/deploy/update-after-create/DATABRICKS_BUNDLE_ENGINE=direct
5:31	aws-ucws windows	TestAccept/bundle/resources/synced_database_tables/basic
5:31	aws linux	TestAccept/bundle/resources/clusters/deploy/update-after-create/DATABRICKS_BUNDLE_ENGINE=direct
5:24	azure windows	TestAccept/bundle/resources/clusters/deploy/update-after-create/DATABRICKS_BUNDLE_ENGINE=direct
5:21	gcp windows	TestAccept/bundle/resources/clusters/deploy/update-after-create/DATABRICKS_BUNDLE_ENGINE=direct
5:04	azure windows	TestAccept/bundle/resources/clusters/deploy/update-after-create/DATABRICKS_BUNDLE_ENGINE=terraform
5:03	azure-ucws linux	TestAccept/bundle/resources/clusters/deploy/update-after-create/DATABRICKS_BUNDLE_ENGINE=terraform
4:55	azure-ucws windows	TestAccept/bundle/resources/clusters/deploy/update-after-create/DATABRICKS_BUNDLE_ENGINE=terraform
4:47	aws-ucws linux	TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_BUNDLE_ENGINE=terraform/DLT=no/NBOOK=yes/PY=no/READPLAN=
4:29	azure-ucws linux	TestAccept/bundle/templates/default-python/combinations/serverless/DATABRICKS_BUNDLE_ENGINE=terraform/DLT=no/NBOOK=yes/PY=yes/READPLAN=
4:23	azure-ucws linux	TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_BUNDLE_ENGINE=direct/DLT=yes/NBOOK=no/PY=no/READPLAN=1
4:04	aws-ucws linux	TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_BUNDLE_ENGINE=direct/DLT=no/NBOOK=yes/PY=yes/READPLAN=
4:02	aws-ucws linux	TestAccept/bundle/templates/default-python/combinations/serverless/DATABRICKS_BUNDLE_ENGINE=direct/DLT=yes/NBOOK=yes/PY=no/READPLAN=1
3:59	aws-ucws windows	TestAccept/bundle/resources/registered_models/basic/DATABRICKS_BUNDLE_ENGINE=direct
3:59	aws-ucws linux	TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_BUNDLE_ENGINE=terraform/DLT=yes/NBOOK=no/PY=yes/READPLAN=
3:53	azure-ucws linux	TestAccept/bundle/resources/registered_models/basic/DATABRICKS_BUNDLE_ENGINE=terraform
3:47	azure-ucws linux	TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_BUNDLE_ENGINE=terraform/DLT=no/NBOOK=no/PY=no/READPLAN=
3:44	azure-ucws windows	TestAccept/bundle/templates/default-python/combinations/serverless/DATABRICKS_BUNDLE_ENGINE=terraform/DLT=no/NBOOK=no/PY=yes/READPLAN=
3:36	aws windows	TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_BUNDLE_ENGINE=terraform/DLT=no/NBOOK=yes/PY=no/READPLAN=
3:35	aws-ucws windows	TestAccept/bundle/resources/clusters/deploy/update-after-create/DATABRICKS_BUNDLE_ENGINE=terraform
3:33	aws-ucws windows	TestAccept/bundle/resources/clusters/deploy/update-after-create/DATABRICKS_BUNDLE_ENGINE=direct
3:33	azure-ucws windows	TestAccept/bundle/templates/default-python/combinations/serverless/DATABRICKS_BUNDLE_ENGINE=direct/DLT=yes/NBOOK=yes/PY=yes/READPLAN=
3:33	azure-ucws linux	TestAccept/bundle/resources/synced_database_tables/basic
3:32	aws-ucws linux	TestAccept/bundle/resources/registered_models/basic/DATABRICKS_BUNDLE_ENGINE=terraform
3:31	azure-ucws linux	TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_BUNDLE_ENGINE=direct/DLT=no/NBOOK=no/PY=no/READPLAN=
3:31	azure-ucws windows	TestAccept/bundle/resources/synced_database_tables/basic
3:29	azure-ucws linux	TestAccept/bundle/templates/default-python/combinations/serverless/DATABRICKS_BUNDLE_ENGINE=terraform/DLT=yes/NBOOK=no/PY=yes/READPLAN=
3:29	azure-ucws linux	TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_BUNDLE_ENGINE=terraform/DLT=no/NBOOK=no/PY=yes/READPLAN=
3:27	azure-ucws linux	TestAccept/bundle/resources/secret_scopes/basic/DATABRICKS_BUNDLE_ENGINE=terraform
3:24	gcp linux	TestAccept/bundle/templates/default-python/integration_classic/DATABRICKS_BUNDLE_ENGINE=direct/UV_PYTHON=3.12
3:17	gcp windows	TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_BUNDLE_ENGINE=direct/DLT=no/NBOOK=no/PY=no/READPLAN=1
3:16	azure-ucws windows	TestAccept/bundle/templates/default-python/combinations/serverless/DATABRICKS_BUNDLE_ENGINE=terraform/DLT=yes/NBOOK=yes/PY=no/READPLAN=
3:15	azure-ucws linux	TestAccept/bundle/templates/default-python/combinations/serverless/DATABRICKS_BUNDLE_ENGINE=terraform/DLT=yes/NBOOK=no/PY=no/READPLAN=
3:13	azure windows	TestAccept/bundle/resources/experiments/basic/DATABRICKS_BUNDLE_ENGINE=direct
3:13	gcp linux	TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_BUNDLE_ENGINE=terraform/DLT=yes/NBOOK=no/PY=no/READPLAN=
3:13	aws windows	TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_BUNDLE_ENGINE=terraform/DLT=yes/NBOOK=no/PY=yes/READPLAN=
3:11	aws-ucws linux	TestAccept/bundle/templates/default-python/combinations/serverless/DATABRICKS_BUNDLE_ENGINE=direct/DLT=no/NBOOK=yes/PY=no/READPLAN=
3:10	gcp linux	TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_BUNDLE_ENGINE=terraform/DLT=yes/NBOOK=no/PY=yes/READPLAN=
3:07	gcp windows	TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_BUNDLE_ENGINE=direct/DLT=yes/NBOOK=no/PY=no/READPLAN=
3:07	azure-ucws linux	TestAccept/bundle/resources/registered_models/basic/DATABRICKS_BUNDLE_ENGINE=direct
3:07	aws-ucws linux	TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_BUNDLE_ENGINE=direct/DLT=no/NBOOK=no/PY=no/READPLAN=
3:07	azure-ucws linux	TestAccept/bundle/templates/default-python/combinations/classic/DATABRICKS_BUNDLE_ENGINE=terraform/DLT=no/NBOOK=yes/PY=no/READPLAN=

lennartkats-db

Minor changes requested

cmd/pipelines/generate.go

lennartkats-db · 2026-01-13T10:14:37Z

cmd/pipelines/generate.go

+	// YAML paths are relative to directory containing YAML file, in this case:
+	// DAB YAML is in "./resources/<directoryName>.pipeline.yml"
+	// SDP YAML is in "./<pipelineDirectoryPath>/spark-pipeline.yml"
+	// NB: all paths are /-based so Windows has the same output


Nit: that's a lotta comments

🤷 These are non-AI comments I wrote by hand. I think it's helpful to have them, otherwise, paths are tricky because they are typed as strings and it's hard to follow in which format they are.

I can't even tell anymore 😭 You can keep them

eng-dev-ecosystem-bot · 2026-01-13T17:53:37Z

Commit: 008b72a

Run: 20964375222

	Env	🟨KNOWN	🔄flaky	💚RECOVERED	🙈SKIP	✅pass	🙈skip	Time
🟨	aws linux	7	2	17	2	417	676	56:50
🟨	aws windows	10		14	2	421	674	53:07
🟨	aws-ucws linux	3		21	2	588	547	78:47
🟨	aws-ucws windows	6		18	2	590	545	77:56
💚	azure linux			19	3	419	675	48:46
🟨	azure windows	4	2	15	3	419	673	56:16
💚	azure-ucws linux			19	3	584	546	78:49
🟨	azure-ucws windows	4		15	3	586	544	78:11
🔄	gcp linux		3	18	3	397	684	62:52
🟨	gcp windows	4	4	15	3	397	682	63:25

34 interesting tests: 15 RECOVERED, 10 KNOWN, 8 flaky, 1 SKIP

	Test Name	aws linux	aws windows	aws-ucws linux	aws-ucws windows	azure linux	azure windows	azure-ucws linux	azure-ucws windows	gcp linux	gcp windows
🟨	TestAccept	🟨K	🟨K	🟨K	🟨K	💚R	🟨K	💚R	🟨K	🔄f	🟨K
💚	TestAccept/bundle/deployment/bind/alert	🙈S	🙈S	🙈S	🙈S	💚R	💚R	💚R	💚R	💚R	💚R
🟨	TestAccept/bundle/generate/alert	💚R	🟨K	💚R	🟨K	💚R	🟨K	💚R	🟨K	💚R	🟨K
🟨	TestAccept/bundle/generate/alert/DATABRICKS_BUNDLE_ENGINE=direct	💚R	🟨K	💚R	🟨K	💚R	🟨K	💚R	🟨K	💚R	🟨K
🟨	TestAccept/bundle/generate/alert/DATABRICKS_BUNDLE_ENGINE=terraform	💚R	🟨K	💚R	🟨K	💚R	🟨K	💚R	🟨K	💚R	🟨K
🔄	TestAccept/bundle/integration_whl/custom_params	🔄f	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p
🔄	TestAccept/bundle/integration_whl/custom_params/DATABRICKS_BUNDLE_ENGINE=direct	🔄f	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p
🔄	TestAccept/bundle/integration_whl/interactive_cluster_dynamic_version	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	🔄f	🔄f
🔄	TestAccept/bundle/integration_whl/interactive_cluster_dynamic_version/DATABRICKS_BUNDLE_ENGINE=direct/DATA_SECURITY_MODE=USER_ISOLATION	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	🔄f	🔄f
🔄	TestAccept/bundle/integration_whl/interactive_single_user	✅p	✅p	✅p	✅p	✅p	🔄f	✅p	✅p	✅p	✅p
🔄	TestAccept/bundle/integration_whl/interactive_single_user/DATABRICKS_BUNDLE_ENGINE=terraform	✅p	✅p	✅p	✅p	✅p	🔄f	✅p	✅p	✅p	✅p
💚	TestAccept/bundle/resources/alerts/basic	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R
💚	TestAccept/bundle/resources/alerts/basic/DATABRICKS_BUNDLE_ENGINE=direct	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R
💚	TestAccept/bundle/resources/alerts/basic/DATABRICKS_BUNDLE_ENGINE=terraform	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R
💚	TestAccept/bundle/resources/alerts/with_file	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R
💚	TestAccept/bundle/resources/alerts/with_file/DATABRICKS_BUNDLE_ENGINE=direct	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R
💚	TestAccept/bundle/resources/alerts/with_file/DATABRICKS_BUNDLE_ENGINE=terraform	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R
🔄	TestAccept/bundle/resources/dashboards/change-name	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	🔄f
🔄	TestAccept/bundle/resources/dashboards/change-name/DATABRICKS_BUNDLE_ENGINE=terraform	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	✅p	🔄f
🙈	TestAccept/bundle/resources/permissions	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🟨	TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/with_permissions	🟨K	🟨K	🟨K	🟨K	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🟨	TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/with_permissions/DATABRICKS_BUNDLE_ENGINE=direct	🟨K	🟨K	🟨K	🟨K
🟨	TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/with_permissions/DATABRICKS_BUNDLE_ENGINE=terraform	🟨K	🟨K	💚R	💚R
🟨	TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/without_permissions	🟨K	🟨K	💚R	💚R	🙈S	🙈S	🙈S	🙈S	🙈S	🙈S
🟨	TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/without_permissions/DATABRICKS_BUNDLE_ENGINE=direct	🟨K	🟨K	💚R	💚R
🟨	TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/without_permissions/DATABRICKS_BUNDLE_ENGINE=terraform	🟨K	🟨K	💚R	💚R
💚	TestAccept/ssh/connection	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R
💚	TestExport	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R
💚	TestExportWithFileFlag	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R
💚	TestImportDir	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R
💚	TestImportDirDoesNotOverwrite	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R
💚	TestImportDirWithOverwriteFlag	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R
💚	TestImportFileFormatAuto	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R
💚	TestImportFileFormatSource	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R	💚R

Top 50 slowest tests (at least 2 minutes):

duration	env	testname
19:25	azure windows	TestAccept/bundle/resources/permissions/factcheck/DATABRICKS_BUNDLE_ENGINE=terraform
13:14	gcp windows	TestAccept/bundle/integration_whl/interactive_cluster_dynamic_version/DATABRICKS_BUNDLE_ENGINE=terraform/DATA_SECURITY_MODE=SINGLE_USER
12:08	azure-ucws windows	TestAccept/bundle/resources/permissions/factcheck/DATABRICKS_BUNDLE_ENGINE=terraform
11:38	gcp windows	TestAccept/bundle/integration_whl/interactive_single_user/DATABRICKS_BUNDLE_ENGINE=terraform
11:38	aws windows	TestAccept/bundle/integration_whl/interactive_cluster_dynamic_version/DATABRICKS_BUNDLE_ENGINE=terraform/DATA_SECURITY_MODE=SINGLE_USER
11:06	aws-ucws linux	TestAccept/bundle/resources/model_serving_endpoints/running-endpoint/DATABRICKS_BUNDLE_ENGINE=direct
10:43	aws-ucws windows	TestAccept/bundle/resources/model_serving_endpoints/running-endpoint/DATABRICKS_BUNDLE_ENGINE=terraform
10:12	aws-ucws windows	TestAccept/bundle/resources/model_serving_endpoints/running-endpoint/DATABRICKS_BUNDLE_ENGINE=direct
9:23	azure-ucws linux	TestAccept/bundle/resources/permissions/factcheck/DATABRICKS_BUNDLE_ENGINE=terraform
8:45	aws-ucws linux	TestAccept/bundle/resources/model_serving_endpoints/running-endpoint/DATABRICKS_BUNDLE_ENGINE=terraform
8:45	aws windows	TestAccept/bundle/integration_whl/base/DATABRICKS_BUNDLE_ENGINE=direct
8:37	gcp windows	TestAccept/bundle/integration_whl/interactive_cluster_dynamic_version/DATABRICKS_BUNDLE_ENGINE=direct/DATA_SECURITY_MODE=SINGLE_USER
8:37	azure linux	TestAccept/bundle/resources/permissions/factcheck/DATABRICKS_BUNDLE_ENGINE=terraform
8:33	aws-ucws windows	TestAccept/bundle/integration_whl/interactive_cluster_dynamic_version/DATABRICKS_BUNDLE_ENGINE=terraform/DATA_SECURITY_MODE=SINGLE_USER
8:08	gcp linux	TestAccept/bundle/integration_whl/interactive_cluster_dynamic_version/DATABRICKS_BUNDLE_ENGINE=terraform/DATA_SECURITY_MODE=USER_ISOLATION
8:02	gcp linux	TestAccept/bundle/integration_whl/interactive_cluster/DATABRICKS_BUNDLE_ENGINE=terraform
7:59	aws linux	TestAccept/bundle/integration_whl/interactive_cluster_dynamic_version/DATABRICKS_BUNDLE_ENGINE=direct/DATA_SECURITY_MODE=USER_ISOLATION
7:58	aws-ucws windows	TestAccept/bundle/integration_whl/interactive_single_user/DATABRICKS_BUNDLE_ENGINE=terraform
7:55	gcp linux	TestAccept/bundle/integration_whl/interactive_cluster_dynamic_version/DATABRICKS_BUNDLE_ENGINE=direct/DATA_SECURITY_MODE=SINGLE_USER
7:50	gcp linux	TestAccept/bundle/integration_whl/interactive_cluster/DATABRICKS_BUNDLE_ENGINE=direct
7:47	gcp windows	TestAccept/bundle/integration_whl/base/DATABRICKS_BUNDLE_ENGINE=direct
7:46	gcp linux	TestAccept/bundle/integration_whl/interactive_cluster_dynamic_version/DATABRICKS_BUNDLE_ENGINE=direct/DATA_SECURITY_MODE=USER_ISOLATION
7:45	gcp windows	TestAccept/bundle/integration_whl/interactive_cluster_dynamic_version/DATABRICKS_BUNDLE_ENGINE=direct/DATA_SECURITY_MODE=USER_ISOLATION
7:44	aws windows	TestAccept/bundle/integration_whl/interactive_cluster_dynamic_version/DATABRICKS_BUNDLE_ENGINE=direct/DATA_SECURITY_MODE=SINGLE_USER
7:44	aws-ucws linux	TestAccept/bundle/integration_whl/interactive_single_user/DATABRICKS_BUNDLE_ENGINE=terraform
7:41	gcp linux	TestAccept/bundle/integration_whl/base/DATABRICKS_BUNDLE_ENGINE=terraform
7:40	aws-ucws linux	TestAccept/bundle/integration_whl/interactive_cluster_dynamic_version/DATABRICKS_BUNDLE_ENGINE=terraform/DATA_SECURITY_MODE=SINGLE_USER
7:39	azure-ucws windows	TestAccept/bundle/integration_whl/interactive_cluster_dynamic_version/DATABRICKS_BUNDLE_ENGINE=direct/DATA_SECURITY_MODE=USER_ISOLATION
7:38	aws-ucws windows	TestAccept/bundle/integration_whl/base/DATABRICKS_BUNDLE_ENGINE=terraform
7:34	aws linux	TestAccept/bundle/integration_whl/interactive_cluster_dynamic_version/DATABRICKS_BUNDLE_ENGINE=terraform/DATA_SECURITY_MODE=SINGLE_USER
7:31	gcp linux	TestAccept/bundle/integration_whl/interactive_single_user/DATABRICKS_BUNDLE_ENGINE=direct
7:28	gcp windows	TestAccept/bundle/integration_whl/base/DATABRICKS_BUNDLE_ENGINE=terraform
7:27	aws-ucws linux	TestAccept/bundle/integration_whl/base/DATABRICKS_BUNDLE_ENGINE=direct
7:23	aws-ucws linux	TestAccept/bundle/integration_whl/base/DATABRICKS_BUNDLE_ENGINE=terraform
7:23	gcp linux	TestAccept/bundle/integration_whl/base/DATABRICKS_BUNDLE_ENGINE=direct
7:20	gcp windows	TestAccept/bundle/run/app-with-job/DATABRICKS_BUNDLE_ENGINE=direct
7:19	aws linux	TestAccept/bundle/integration_whl/interactive_single_user/DATABRICKS_BUNDLE_ENGINE=terraform
7:19	gcp linux	TestAccept/bundle/run/app-with-job/DATABRICKS_BUNDLE_ENGINE=direct
7:13	azure linux	TestAccept/bundle/integration_whl/interactive_cluster/DATABRICKS_BUNDLE_ENGINE=direct
7:10	aws windows	TestAccept/bundle/integration_whl/interactive_single_user/DATABRICKS_BUNDLE_ENGINE=terraform
7:07	gcp linux	TestAccept/bundle/integration_whl/interactive_cluster_dynamic_version/DATABRICKS_BUNDLE_ENGINE=terraform/DATA_SECURITY_MODE=SINGLE_USER
7:02	azure-ucws linux	TestAccept/bundle/run/app-with-job/DATABRICKS_BUNDLE_ENGINE=direct
7:01	aws-ucws linux	TestAccept/bundle/resources/clusters/run/spark_python_task/DATABRICKS_BUNDLE_ENGINE=direct
6:55	aws-ucws windows	TestAccept/bundle/integration_whl/base/DATABRICKS_BUNDLE_ENGINE=direct
6:53	azure linux	TestAccept/bundle/integration_whl/base/DATABRICKS_BUNDLE_ENGINE=direct
6:51	gcp linux	TestAccept/bundle/integration_whl/interactive_single_user/DATABRICKS_BUNDLE_ENGINE=terraform
6:47	gcp windows	TestAccept/bundle/run/app-with-job/DATABRICKS_BUNDLE_ENGINE=terraform
6:43	aws windows	TestAccept/bundle/integration_whl/base/DATABRICKS_BUNDLE_ENGINE=terraform
6:40	gcp linux	TestAccept/bundle/resources/clusters/run/spark_python_task/DATABRICKS_BUNDLE_ENGINE=terraform
6:38	gcp linux	TestAccept/bundle/run/app-with-job/DATABRICKS_BUNDLE_ENGINE=terraform

kanterov requested review from jefferycheng1 and lennartkats-db as code owners January 12, 2026 09:16

kanterov temporarily deployed to test-trigger-is January 12, 2026 09:16 — with GitHub Actions Inactive

pipelines: add generate command

b71da84

kanterov force-pushed the pipelines-generate branch from ed6f29d to b71da84 Compare January 12, 2026 09:21

kanterov temporarily deployed to test-trigger-is January 12, 2026 09:22 — with GitHub Actions Inactive

kanterov requested a review from andrewnester January 12, 2026 09:25

andrewnester approved these changes Jan 12, 2026

View reviewed changes

Fix Windows tests

2def671

kanterov temporarily deployed to test-trigger-is January 12, 2026 12:54 — with GitHub Actions Inactive

Fix Windows tests

075eb44

kanterov temporarily deployed to test-trigger-is January 12, 2026 13:29 — with GitHub Actions Inactive

Add --existing-pipeline-dir flag

3021665

lennartkats-db requested changes Jan 13, 2026

View reviewed changes

Address CR feedback

0bdaa39

kanterov temporarily deployed to test-trigger-is January 13, 2026 13:01 — with GitHub Actions Inactive

Fix Windows tests

5c86ec9

kanterov temporarily deployed to test-trigger-is January 13, 2026 13:23 — with GitHub Actions Inactive

Fix Windows tests

2d546c1

kanterov requested a review from lennartkats-db January 13, 2026 14:37

kanterov temporarily deployed to test-trigger-is January 13, 2026 14:37 — with GitHub Actions Inactive

lennartkats-db approved these changes Jan 13, 2026

View reviewed changes

kanterov added this pull request to the merge queue Jan 13, 2026

Merged via the queue into main with commit 008b72a Jan 13, 2026
21 checks passed

kanterov deleted the pipelines-generate branch January 13, 2026 16:24

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Comments

pipelines: add generate command#4251

pipelines: add generate command#4251
kanterov merged 7 commits intomainfrom
pipelines-generate

kanterov commented Jan 12, 2026 •

edited

Loading

Uh oh!

eng-dev-ecosystem-bot commented Jan 12, 2026 •

edited

Loading

Uh oh!

lennartkats-db left a comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

lennartkats-db Jan 13, 2026

Uh oh!

kanterov Jan 13, 2026

Uh oh!

lennartkats-db Jan 13, 2026

Uh oh!

Uh oh!

eng-dev-ecosystem-bot commented Jan 13, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

Comments

Conversation

kanterov commented Jan 12, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Changes

Usage

Why

Tests

Uh oh!

eng-dev-ecosystem-bot commented Jan 12, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

lennartkats-db left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

lennartkats-db Jan 13, 2026

Choose a reason for hiding this comment

Uh oh!

kanterov Jan 13, 2026

Choose a reason for hiding this comment

Uh oh!

lennartkats-db Jan 13, 2026

Choose a reason for hiding this comment

Uh oh!

Uh oh!

eng-dev-ecosystem-bot commented Jan 13, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

kanterov commented Jan 12, 2026 •

edited

Loading

eng-dev-ecosystem-bot commented Jan 12, 2026 •

edited

Loading